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DATA ACCESSION PROCESS 

This invention relates to the accession of latency dependant traffic like voice 
and video conferencing data from remote internet based servers and applications. In 
5 such traffic it is important to mimimise delay times as users are interacting in real 
time. 

Currently, if a user having a high bit rate {2Mb/s) ADSL (asymmetric digital 
subscriber loop) connection attempts to send or receive real time data over the 
internet the results may not be satisfactory as the data packets can get delayed due 

10 to congestion and contention for capacity with other users over shared intermediate 
links. This delay is variable as it depends on what other traffic is present from 
moment to moment. It is possible to alter the underlying network to prioritise real 
time traffic - see for example International Patent Application W099/12329, but this 
requires changes to the core Internet Protocol (IP) network. 

1 5 The concept of using multiple virtual connections and access connections to 

support improved throughput is already established and implemented in the form of 
Inverse Multiplexing for ATM (IMA) (ATM-Forum AF'PHY-0086.0010)\ for internet 
access the end user would get a single IP address and the access server would 
reassemble the data into one stream for routing across the internet. Note the access 

20 server is the gateway between the connection orientated ATM access network and 
the IP routed core. Therefore there would be no benefit if the bottleneck is in fact 
between the access server and the application being accessed across the internet. 

Most access networks have the capability to allow an end user, if he so 
chooses, to gain access several times simultaneously, using the same or different 

25 internet service providers. Each time the user logs on he gets another IP address. To 
the core IP network these addresses all appear to be separate users. When it is 
heavily loaded, the core network divides its bandwidth up equally between the 
addresses contending for access, so a user who has logged on three times will get 
three times as much bandwidth as a user logged on only once. The mechanism to log 

30 on a plurality of times could be multiple asynchronous transfer mode (ATM) 
permanent or switched virtual connections (PVCs or SVCs), or the PPPoE (Point to 
Point Protocol over Ethernet). A web based server or peer application., receivmg 
requests for a particular stream from three separate IP address wijl- expeqt,; the 



requests to have come from three different users and act accordingly. For example ^ 
video conference bridge will add three new users to the requested conference and 
relay the video / voice data received from each one to the other two. Note that the 
signals are duplicates of each other, so unless additional measures are taken, which 
are the subject of the applicant's co-pending application having applicant's reference 
A30190 and filed on the same date as the present application, the additional 
bandwidth does not allow the user to obtain convey any additional information. 

Although each data stream will be the same, the variable delay means that 
different connections will be closest to real time at different times. If the Initially 
optimum connection is subsequently swamped by a number of large packets, later 
packets in that stream may be delayed by more than their equivalents in another 
stream. 

According to the invention, a user terminal for accessing data from a web 
based server or peer application over a distributed information network, is provided 
with means for generating a plurality of access requests for a plurality of duplicate 
series of packet data from one source over a plurality of routes, each series 
comprising one instance of each packet of an ordered set of packets, means for 
accepting the first instance to be received of each packet in the series, and means for 
assembling the accepted packets into a complete series. 

Another aspect of the invention provides a method of accessing data from a 
internet application over a distributed information network, wherein a plurality of 
access requests are generated for a plurality of duplicate series of packet data from 
one source over a plurality of routes, each series comprising one instance of each 
packet of an ordered set of packets, and wherein the first Instance to be received of 
each packet in the series is accepted, and the accepted packets are assembled into a 
complete series. 

This invention relies on the user terminal and source server communicating 
with each other using real time data, to have a choice of routes to send the data. The 
sending application transmits the real time data over two or more routes 
simultaneously. The receiving application then has an improved chance of receiving 
each packet within an acceptable time, as the probability of the same packet being 
extensively delayed over all routes is relatively small. 



In a preferred arrangement, the user terminal has means for determining the 
packet delay and variation over a first route and, if the packet delay and variation 
exceed acceptable limits in the access network, generating a request for access by 
means of one or more further routes. This allows the end user to choose to log on 
5 one or more times to one or more internet service providers. Each time he logs on, he 
is given another IP {Internet Protocol) address. The core IP network responds as if 
each address is a separate user. 

With minor changes most access networks have the capability to allow an 
end user, if he so chooses, to gain access several times simultaneously, using the 
10 same or different internet service providers. Each time the user logs on he gets 
another IP address. To the core IP network these addresses all appear to be separate 
users. 

If the user logs on several times to the same Internet Service Provider (ISP) 
he will be allocated addresses on the same end-routed domain so the data is very 
1 5 likely to take a similar route over the internet, reducing the likely benefits of diversity. 
However, if the user logs on to three different ISPs there is a far greater chance that 
the data will take different routes across the internet and so be subject to different 
delay profiles. 

The mechanism to log on multiple times could be any existing system such 
20 as multiple Asynchronous Transfer Mode (ATM) Permanent or Switched Virtual 
Connections {PVCs or SVCs), or the PPPoE (Point to Point Protocol over Ethernet). 

The application which is to send data to the end user will register two or 
more addresses to which to send duplicate data. The receiving application is arranged 
to use the first packet that Is received and discard the duplications when they are 
25 subsequently received. Note that instances of subsequent packets from each route 
may be delivered in a different order from the order In which the Instances of the first- 
packet arrive. Thus one packet stream may deliver the first packet of the stream 
before another packet stream does so, but the second packet of that stream may be 
delayed to such an extent that it arrives after both the (duplicate) first packet and the 
30 second packet of another stream are delivered. For each packet, the first instance to 
arrive at the user terminal is assembled, so that an aggregate data stream is 
generated having lower delay, and lower delay variation, than any of the individual 
streams could have generated on its own. 



r 




It is possible that packet series delivery on one access route has fallerr 



4 




substantially behind others, so that no packets are being used from that route. In that 
case, it may be desirable to make an adjustment to the delivery process on that 
access route.- This may be simply be closing the connection, thereby saving on 
5 bandwidth, and therefore cost if payment is made by time or number of packets 
delivered. Alternatively the access server may be requested to omit a specified 
number of packets (which have already been received over one of the other duplicate 
routes) 



10 streams. It is therefore possible for the first instance of a packet to arrive on one 
route out of. sequence, that is to say before the arrival (over another route) of the 
first (uncorrupted). instance of the packet that should precede it. If accuracy is 
important, the out of sequence packet may be buffered until the arrival of the first 
instance of the packet that should precede it, so that it can be assembled in its 

1 5 correct place in the output sequence. However, in some forms of real-time signalling, 
such as video conferencing, speed takes priority over accuracy. In such 
circumstances the out-of-sequence packet may be output immediately it arrives over 
a first route, all instances of the packet that should have preceded (including the first 
instance) it being disregarded when they eventually arrives over another route. 

20 If additional bandwidth is required on one or more of the channels, the 

present invention may be used in combination with that of the applicant's co-pending 
application A30190, previously referred to. For example using six feeds (IP 
Addresses), the stream may be split into two to double the bandwidth, and then 
these two streams are then each duplicated three times to reduce delay according to 

25 the present invention) 

Embodiments of the invention will now be described, by way of example, 
with reference to the drawings in which: 

Figure 1 is a schematic illustration of a prior art Single ISP Connection 

Service 

30 Figure 2 is a schematic illustration of the connection of three switched virtual 

connections (SVCs) to three Internet Protocol (IP) Addresses; 

Figure 3 is a schematic illustration of a system operating according to the 
invention, with duplicated data streaming. 



Packets may have been omitted or corrupted in one or more of the packet 
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Figure 4 is a flow chart illustrating the method of operation of one 
embodiment of the invention. 

Figure 5 is a flow chart showing one method of assembly of the incoming bit 

streams 

5 , Figure 6 is a flow chart showing an alternative method of assembly of the 

incoming bit streams 

In all these figures, data is shown in one direction only. It will be appreciated 
that for applications like video conferencing there would normally be similar streams 
in the reverse direction . 

10 As shown in the conventional system of Figure 1 , a single permanent virtual 

circuit (PVC) 10 is set up between the user terminal 1 of an ADSL user, and the 
access server 1 1 . The access server 1 1 terminates the PVC 1 0 and the Point to Point 
Protocol (PPP) (12) signalling encapsulated onto the PVC. It also gives the end user 
terminal 15 an IP address IX to enable it. to connect to the internet (shown genaerlly 

15 at 14), and send data to any other internet application, for example a video, 
conferencing application 17 (Figure 3). 

With a switched virtual circuit (SVC) ADSL multiplexer (DSLAM) 20 the end 
user terminal 15 can connect simultaneously to multiple access servers 21, 22, 23. 
Figure 2 shows the user logged on to three different internet service providers. Again 

20 using PPP the user is given a unique routable IP address 21 X, 22Y, 23Z for each 
connection. The Increased number of connections marginally increases the contention 
level (the number of individual IP addresses attempting to access data), which in turn 
may affect the data rate on each channel at busy times. 

For real time data, the time the data takes to traverse the network, known as the 

25 "latency" or "delay'' of the network, is very important. . The latency of satellite systems 
is significantly worse than other systems because of the extra distance the data has to 
travel. (The round-trip distance to a geostationary satellite is approximately 0.25 
seconds.) If the data were to be split and different parts of it sent over different 
routes, the process of storing the retrieved data until it had all been received would 

30 result in the latency of the transmission being dictated by that of the poorest service 
provider. 

The system shown in Figure 3 avoids this problem by requesting the same 
data several times. This may appear to be an inefficient use of resources, in that data 



i 

is duplicated. However, the invention merely uses some of the capacity available to* 
the user minimise delay rather than to optimise some other characteristic such as 
picture quality. 

The internet application sending the data, for example a video conferencing 
5 application 17, sends the data out on three different paths 21, 22, 23. The latencies 
of networks vary dynamically due to variable traffic loading. Consequently the 
sequenced data frames may be received at different delays and it will not always be 
any given path 21, 22, 23 that is quickest. As will now be described with reference 
to Figure 4, the receiving application 15 processes the sequenced data frame 
10 (packet) that is received first and ignores the same data frame when subsequently 
received via another route. Figure 3 also shows illustrative data streams operated 
according to the invention. 

As shown in. Figure 4, the user terminal 15 first logs on to one or more ISPs 
21, 22, 23 and gets a user address X, Y, Z for each, (step 40). It then requests 
15 access to the internet application 17 over one of the ISP networks 21 {step 41). The 
requested data is returned from the internet application 17 to the user terminal 15, 
and the packets are reassembled into a data stream 16 (step 43). The user terminal 
1 5 then determines whether the rate at which the data is arriving is acceptable (step 
44). If it is acceptable it is delivered to the user by way of a display or other human 
20 interface (step 47). If the rate is not acceptable, a request is made top the same 
internet application 17, using a different ISP 22 (step 45). (Logging on to the second 
ISP may take place at this point, or at the same time as the first ISP as shown in 
Figure 4). The same data is therefore now sent to the user terminal 15 from the 
internet application 17 by two different routes 21, 22. This cycle is continued until 
25 an acceptable rate is achieved (or the user runs out of available ISPs to use). 

The assembly step 43 will be described in more detail, with reference to 
Figures 5 and 6. Some of the steps in Rgures 5 and 6 are similar: where this is the 
case they are referenced with the same two final digits. 

Each packet of a stream has a position value R, which identifies where it 
30 should come in the stream. In the present invention, a plurality of identical streams 
are being delivered and there should therefore be a plurality of instances of packets 
having each value R. The user terminal should identify and use the first instance of 
each value of R and discard the rest. The user terminal keeps a running total N of the 
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position value R which the user terminal 15 is expecting - in other words the highest 
value of R so far received is N-1 . As shown in Figures 5 and 6, this is initially set at a 
value of 1 (step 431/631). 

When a packet is received, (step 432/632) the position value R Is compared 
5 with the running total N (step 433/633). If R and N are equal, signifying that this is 
the first instance of that packet to arrive, the packet is added to the output stream 
(step 435/635) and the running total is incremented by 1 (step 436/636). If the 
position value is less than the running total, this signifies that a packet having the 
same position value (and therefore a duplicate of the present packet) has previously 

10 been received, and this packet can be discarded (step439/639). 

In the example shown in Figure 3, the first packet is delayed by different 
amounts in the paths 21, 22, 23, and the user terminal 15 receives it first on path 21 
(packet 1) and assembles it as the first element of an output stream 16. Packets 1', 
1", arriving later on the other two paths, are redundant and disregarded. The second 

15 and third packets (packets 2,3) on path 21 also arrive before their duplicates (2', 3', 
2", 3") on the other paths 22, 23. However, the fourth packet (4) has its journey 
through the path 21 delayed, and the first instance of this packet to arrive is instead 
the packet 4" on path 23. This is then added to the assembled output stream 1 6. 
Similarly, the fifth packet is seen first on the path 23 (packet 5") and Is added to the 

20 output stream 16. Duplicate packets (4, 4', 5, 5') are again disregarded when they 
eventually arrive. 

In the example of Figure 3, path 23 now also experiences a delay, and path 
21 has not yet recovered from the earlier delay, so the first Instance of packet 6 to 
arrive is that on the remaining path 22 (packet 6'), and this is duly added to the 
25 output stream, packets 6, 6" being disregarded when they arrive. 

The end user 15 therefore gets the lowest delay possible from any of the 
three networks. 

It should be understood that data streams in practice include thousands of 
individual packets, and the change in relative delay between one path and another is .. 
30 likely to occur on longer timescales than the one or two packets shown here. 

On occasion packets are corrupted, lost altogether, or arrive in the wrong 
order, as a result of variations in switching delay even over the same virtual 
connection. This can result in a packet arriving which is Intended for later in the 
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sequence than the one that Is expected. In other words, the position value R 
greater than the running total N. Figures 5 and 6 illustrate two different ways of 
handling such packets in such a situation. 

In Ffgure 5, should a packet arrive out of sequence, its position value R', 
5 when checked (step 433) will be found to be greater than the running total N. It is 
nevertheiss added to the output stream 16, and the. running total N incremented to 
the position value of the following packet (R' + l), This means that all instances of 
the packet that had been expected (which has position value R, (R<R'), will now be 
discarded (step 439). This arrangement ensures that corrupted packets do not delay 

10 the output stream, but loses some accuracy because of the omitted packets. 

In the arrangement of Figure 6,. In which steps similar to those of Figure 4 
are given the same reference numerals incremented by 200, if the position value R' is 
found to be higher than the running total N the packet is added to a buffer (step 634) 
instead of the output stream 1 6. When a subsequent packet is added to the output 

15 stream 16 (step 635) and the running total incremented (step 636), a check is made 
to see if the next packet (having a position value R equal to the incremented running 
total) is already present in the buffer (step 637). If it is already buffered it is added to 
the output stream (step 635) without the need to wait for a second instance of the 
packet to be delivered. More than one buffered packet may be delivered in this way 

20 before the next packet arrives (step 632). This arrangement allows greater accuracy 
than that of Figure 4, without losing all the advantages of speed that the process of 
Figure 4 enjoys. 
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CLAIMS 

1. A user terminal for accessing data from a internet application over a 
distributed information networlc, provided witli means for generating a plurality of 

5 access requests for a plurality of duplicate series of packet data from one source over 
a plurality of routes, each series comprising one instance of each packet of an 
ordered set of packets, means for accepting the first, instance to be received of each 
packet in the series, and means for assembling the accepted packets into a complete 
series. 

10 

2. A terminal according to claim 1, comprising means for determining the 
packet delay and variation over a first route and, if the packet delay and variation 
exceed acceptable limits in the access network, generating a request for access by 
means of one or more further routes. 

15 

3. A terminal according to claim 1 or 2, comprising means for identifying an 
access route on which packet series delivery has fallen substantially behind others, 
and means for requesting an adjustment to the delivery process on that access route. 

20 4. A terminal according to any preceding claim, comprising means for detecting 
the arrival of the first instance of a packet out of sequence, and means for buffering 
* the said out of sequence packet until the first instance of any packets that should 
have preceded it are received. 

25 5. A terminal according to any of claims 1 to 3, comprising means for detecting 
the out of sequence arrival of the first instance of a packet, and means for 
disregarding the subsequent arrival of all instances of any packets that should have 
preceded the out of sequence packet. 

30 6. A method of accessing data from a internet application over a distributed 
information network, wherein a plurality of access requests are generated for a 
plurality of duplicate series of packet data from one source over a plurality of routes, 
each series comprising one instance of each packet of an ordered set of packets, and 



wherein the first instance to be received of each packet in the series is accepted, ana 
the accepted packets are assembled into a complete series. 

7. A method of accessing data from a internet application over a distributed 
,5 information network, wherein initially a first access request is made for a series of 

data packets to be received over a first route, the packet delay and variation of 
packets received over the first route is measured and, if the packet delay and 
variation exceed a predetermined limit, one or more requests for duplicate series of 
data packets are obtained according to the method of claim 6. 

10 

8. A method according to claim 6 or claim 7, wherein the duplicate series of 
packets are obtained using different access servers. 

9. A method according to claim 6, 7 or 8, wherein if packet series delivery on 
1 5 one access route has fallen substantially behind others, an adjustment to the delivery 

process is made on that access route. 

10. A method according to claim 6, 7, 8, or 9, wherein if the arrival of the first 
instance of a packet is out of sequence, the said out of sequence packet is buffered 

20 until the first instance of any packets that should have preceded it are received. 



11. A method according to any of claims 6, 7, 8 or 9, wherein if the arrival of 
the first instance of a packet is out of sequence, all instances of any packets that 
arrive subsequently but should have preceded the out of sequence packet are 
25 disregarded. 
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ABSTRACT 
DATA ACCESSION PROCESS 

A user terminal (15) accesses data from an internet application (14) over a 
5 distributed information networic sucli as tlie Internet (17), by making a plurality of 

access requests for a plurality of duplicate series of packet data (1,2,3, ; 

1',2',3',....; 2", 3", ) from the same internet application (14), each series 

comprising one instance of each packet of an ordered set of packets 1,2,3,4,5,6. 
The first instance to be received of each packet in the series (1,2,3,4",5'',6') is 
10 accepted, and the accepted packets are assembled into a complete series (16). This 
ensures that delays on any one link (21, 22, 23) do not delay the receipt of the 
message. 

Figure 3 

15 
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